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Abstract 

Let G be a random graph on the vertex set {1, 2, . . . , n} such that edges in G are 
determined by independent random indicator variables, while the probability pij for 
being an edge in G is not assumed to be equal. Spectra of the adjacency matrix 
and the normalized Laplacian matrix of G are recently studied by Oliveira and Chung- 
Radcliffe. Let A be the adjacency matrix of G, A = E(A), and A be the maximum 
expected degree of G. Oliveira first proved that almost surely \\A — A\\ = 0(V A In n) 
provided A > C In n for some constant C . Chung-Radcliffe improved the hidden constant 
in the error term using a new Chernoff-type inequality for random matrices. Here we 
prove that almost surely \\A — A\\ < (2 + o(l))vA with a slightly stronger condition 
A 3> In 4 n. For the Laplacian L of G, Oliveira and Chung-Radcliffe proved similar 
results || L — L\ = 0(\/\nn/ \/~8) provided the minimum expected degree 5 3> Inn; we 
also improve their results by removing the Vlnn multiplicative factor from the error 
term under some mild conditions. Our results naturally apply to the classic Erdos- 
Renyi random graphs, random graphs with given expected degree sequences, and bond 
percolation of general graphs. 

1 Introduction 

Given anjixn symmetric matrix M, let Ai(M), \2(M), . . . , X n (M) be the list of eigenvalues 
of M in the non-decreasing order. What can we say about these eigenvalues if M is a matrix 
associated with a random graph Gl Here M could be the adjacency matrix (denoted by A) 
or the normalized Laplacian matrix (denoted by L). Both spectra of A and L can be used 
to infer structures of G. For example, the spectrum of A is related to the chromatic number 
and the independence number. The spectrum of L is connected to the mixing-rate of random 
walks, the diameters, the neighborhood expansion, the Cheeger constant, the isoperimetric 
inequalities, the expander graphs, the quasi-random graphs. For more applications of spectra 
of the adjacency matrix and the Laplacian matrix, please refer to monographs [3J[S]. 

Spectra of adjacency matrices and normalized Laplacian matrices of random graphs 
were extensively investigated in the literature. For the Erdos-Renyi random graph model 
G(n,p), Fiiredi and Komlos [TS] proved that almost surely X n (A) = (1 + o{l))np and 
maxi<„_i |Ai(A)| < (2 + o{l))^np(\ — p) provided np(l — p) >• log 6 n; similar results are 
proved for sparse random graphs [13 [TB] and general random matrices [TU1 [H] ■ Alon, Kriv- 
elevich, and Vu [1] showed that with high probability the s-th largest eigenvalue of a random 
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symmetric matrix with independent random entries of absolute value at most one concen- 
trates around its median. Chung, Lu, and Vu [H [5] studied spectra of adjacency matrices 
of random power law graphs and spectra of Laplacian matrices of random graphs with given 
expected degree sequences. Their results on random graphs with given expected degree se- 
quences were complemented by Coja-Oghlan [7j [8] for sparser cases. For random d-regular 
graphs, Friedman (in a series of papers) [HJ[T21[T3] proved that the second largest eigenvalue 
(in absolute value) of random d-regular graphs is at most (2 + o(l))y/d — 1 almost surely for 
any d > 4. 

In this paper, we study spectra of the adjacency matrices and the Laplacian matrices 
of edge-independent random graphs. Let G be an edge-independent random graph on the 
vertex set [n] := {l,2,...,n}; two vertices i and j are adjacent in G with probability pij 
independently. Here {pij}i<i,j<n are not assumed to be equal. Let A :— (py)f - =1 be the 
expectation of the adjacency matrix A and A be the maximum expected degree of G. Oliveira 
[T7] proved \\A — A\\ = 0(y/AAan) provided A > CTnn for some constant C. Chung and 
Radcliffe [5] improved the hidden constant in the error term using a Chernoff-type inequality 
for random matrices. We manage to remove the y/1n n-factor from the error term with a 
slightly stronger assumption on A. We have the following theorem. 

Theorem 1 Consider an edge-independent random graph G. If A In 4 n, then almost 
surely 

\Xi(A) - *i(A)\ < (2 + o(l))VA 

for each 1 < i < n. 

Let T be the diagonal matrix of expected degrees. Define L = I — T -1 / 2 AT^ 1 / 2 . The 
matrix L can be viewed as the "expected Laplacian" of G. Oliveira [T7] and Chung-Radcliffc 
[6] proved theorems on L which are similar to those on the adjacency matrix A. We are 
able to improve their results by removing the Vhi n- factor from the error term with some 
conditions. We say that L is well-approximated by a rank fc-matrix if there is a k such that 
all but k eigenvalues Aj(L) satisfy |1 — Aj(Z)| = o(l/\/lnn). To make the definition rigorous, 

let 

A:-{A,(L): (l-A^L)] > l/(g(n) VhT^)}, 

where gin) is an arbitrarily slowly growing function; then we have k :— |A|. We have the 
following theorem. 

Theorem 2 Consider an edge-independent random graph G. Let A and k be defined above. 
If the minimum expected degree 5 satisfies 8 3> max{fc, In n\, then almost surely, 

\K{L)-\ t {L)\< ^ 2 + ^E( 1 - A ) 2 +°( 1 ) 

for each 1 < i < n. 

Note rank(7 — L) = rank(^4). We have the following corollary. 

Corollary 1 Consider an edge-independent random graph G with rank(A) = k. If the min- 
imum expected degree 8 satisfies 8 3> max{fc, In 4 n}, then almost surely, we have 

|A, W -A,(£)|< 2 + ^ + °"» 

for 1 < i < n. 
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A special case is the random graph G(w) with given expected degree sequence w = 
(wi, u>2, . . . , w n ), where ViVj is an edge with probability pij — ^j"'"' J tUl ■ Let S = w min and 

w = ^' =1 — . Chung-Lu-Vu [5] proved if 6 3> yfw~ In 3 n then for each non-trivial eigenvalue 
A,(X), we have 



Note that in this case I - L = T^ 1 / 2 AT^ 1 / 2 ; its (£, j)-entry is given by ^' Wj . Thus 

I — L is a rank-1 matrix with non-zero eigenvalues equal 1. Hence all non-trivial eigenvalues 
of L arc 1. Applying Corollary [1] we get 

|l-A i( L)|<i±^, (2) 

provided 8 >• In 4 n. 

In comparison to inequality (JTJ) , inequality ^ improves the constant factor with a weaker 
condition. 

Here is another application. Let G be a host graph with vertex set [n]. The bond 
percolation of G (with probability p) is a random spanning subgraph G p of G such that for 
each edge {i,j} of G, {i,j} is retained as an edge of G p with probability p independently. 
The Erdos-Renyi graph G(n,p) can be viewed as the bond percolation of the complete graph 
K n . We have the following theorems on the spectrum of G p for a general graph G. 

Theorem 3 Suppose that the maximum degree A of G satisfies A 3> ln 4 n. For p 3> ln A " , 
almost surely we have 



\Xi(A(G p )) - p\i(A(G))\ < (2 + o(l))Vf>A. 
Theorem 4 Suppose that all but k Laplacian eigenvalues X of G satisfies |1 — A| = o( * ) 



n n 



If the minimum degree 8 of G satisfies S 3> max{/c, In 4 n}, then for p 3> max{-|, ln A - - }, almost 
surely we have 



Xi{L(G p )) - Xi(L(G))\ < 



k 



(l-A 4 ) 2 +o(l)) 



where Ai, . . . , Afe are those k Laplacian eigenvalues of G do not satisfy |1 — A| = o( -^= ). 

The rest of the paper is organized as follows. In section 2, we will generalize Vu's result 
|18) on the spectral bound of a random symmetric matrix; we use it to prove theorem [TJ In 
section 3, we will prove several lemmas for Laplacians. Finally, Theorem [5] will be proved in 
Section 4. 



2 Spectral bound of random symmetric matrices 

For any matrix M, the spectral norm \\M\\ is the largest singular value of M; i.e., we have 

||M|| - y/ X max {M*M). 

Here M* is the conjugate transpose of M and X max {*) is the largest eigenvalue. When M is 
a symmetric matrix with non-negative entries, we have ||Af|| = X max {M). 

We will estimate the spectral norm of random symmetric matrices. Let us start with the 
following theorem proved by Vu in [18 . 
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Theorem 5 There are constants C and C such that the following holds. Let bij, 1 < i < 
j < n be independent random variables, each of which has mean and variance at most a 2 
and is bounded in absolute value by K, where a > C' n~ Y l 2 K In 2 n. Then almost surely 

\\B\\ < 2o-^h~+C(Ka) 1/2 n 1 / i \nn. (3) 

Vu's theorem is already in a very general form; it improves Fiiredi-Komlos's result |15j 
on G(n,p). When we consider an edge-independent random graph G, let A be the adjacency 
matrix of G and A be the expectation of A. If we apply Theorem[5]to B := A — A, we get 

\\A- A\\ < 2aVn~+C(o-) 1/2 n 1/4 \nn, (4) 

where a = maxi<i<j< n {y/pij(l — Py)}- The upper bound in inequality Q is weaker than 
the one in Theorem [TJ this is because the uniform bounds on K and a 2 are too coarse. 

To overcome the deficiency, we assume that by (1 < i < j ' < n) are independent random 
variables with the following properties: 

• \hj I < K for 1 < i < j < n; 

• E(6y) = 0, for all 1 < i < j < n; 

• Var(6y)<4. 

If i > j, we set bji = by and <jji = cry. Consider a random symmetric matrix B — (by)™,- =1 . 
The following theorem generalizes Vu's theorem. 

Theorem 6 There are constants C and C' such that the following holds. Let B be the 
random symmetric matrix defined above and A = maxi<j< n Xy=i °y ■ V ^ — C'K 2 \n n, 
then almost surely 

\\B\\ < 2v / A + CVXA 1/4 lnn. (5) 

When cry = a, we have A = ncr 2 . Thus, inequality (J5J) implies inequality ([3]). (The condition 
A > C'K 2 In 4 n becomes a > VC'n^^Kln 2 n.) 

Replacing B by cB, K by cK, and A by cA, inequality ((5|) is invariant under scaling. 
Without loss of generality, we can assume K — 1 (by scaling a factor ) . We further assume 
that diagonal entries are zeros. Changing diagonal entries to zeros can affect the spectral 
norm by at most K, which is negligible in comparison to the upper bound. 

We use Wigner's trace method pj)]. We have 

E (Trace(B fe )) = £ E(b ili2 b i2ia . . . b ik _ lik b ikil ). (6) 

ii,iai— ,ifc 

Each sequence w :— ■ • • ik-iikH is a closed walk of length k in the complete graph K n . 
Let E(w) be the set of edges appearing in w. For each edge e € E(w), let c/ e be the number 
of occurrence of the edge e in the walk w. By the independence assumption for edges, we can 
rewrite equation ([6]) as 

E (Traced)) =E II E (^)- (7) 

Here the summation is taken over all closed walks of length k. If q e = 1 for some e € E(w), 
then rieeBfiti) E( c e c ) = 0- Thus we need only to consider all closed walks such that each edge 
appears at least twice. 

A closed walk w is good if each edge in E(w) occurs more than once. The set of all good 
closed walks of length k in K n is denoted by Q(n,k). 
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Since q e > 2 and \b e \ < 1, we have 

|E(&?)|<E(6 2 J=Var(& 2 )<a 2 . (8) 
Putting equation ^7} an d inequality ([5]) together, we have 

|E (Traced)) | < £ J] a 2 . (9) 

weG(n,k) eeE(u;) 

Let C/(n, fc,p) be the set of good closed walks in _ftT„ of length k and with p vertices. The 
key of the trace method is a good estimate on \Q(n, k,p)\. Furedi and Komlos [TS] proved 

\G(n, k,p)\<n(n-l)...(n-p + l)^ (**~^ ( k _ \^-^) . (i ) 

Let Q(k,p) be the set of good closed walks w of length k on [p] where vertices first appear 
in w in the order 1,2,... ,p. It is easy to check \G(n, k,p)\ — n(n — 1) • • • (n — p + l)\Q(k,p)\. 
The main contribution from Vu's paper [18] is the following improved bound (see [18j , Lemma 
4.1): 

\Q(k,p)\<( k V 2fe - 2 f + V" 2p+2 (fc-2p + 4) fe - 2 f+ 2 . (11) 
\2p - 2 J 

We will use this bound to derive the following Lemma. 

Lemma 1 For any even integer k such that k 4 < ^ , we have 

|E(Tracc(5 fe ))| < 2 k+2 nA k/2 . (12) 

Proof: Let [n]£ := {(vx,V2, ...,V P ) G [n] p : vi,v 2l ■ ■ ■ , v p are distinct}. Define 

tf>: G(n,k,p) -> G(k,p) x [ n ]£ 

as follows. For a good closed walk w — i\i-x . . . ikh G Q(n, k,p), let Ui,«2> • • • , v p be the list 
of p vertices in the order as they appear in w. Replacing Vi by i for 1 < i < p, we get a good 
closed walk w G Q(k,p). Now we define </>(w) = (w, (ui, U2, ■ • ■ , %>))■ Clearly is a bijection. 

For any w G Q{k 1 p), we define a rooted tree T (with root 1) on the vertex set [p] as 
follows: 

ijij+i G S(T) if and only if $ ■ ■ ■ , ij}- 

Equivalently, the edge ijij+i G E(T) if it brings in a new vertex when it occurs first time. 
For 2 < I < p, let 77 (Z ) be the parent of Since c 2 < K 2 — 1 always holds, we can discard 
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those terms cr 2 for e ^ T(w). We get 

e n e e n 

weg(n,fe,p) eeE(w) w£Q(k,p) (v 1 ,...,v p )£[n]S-xyeE(w) 

n n n 

— E E E ' ' ' E IT a v m v y 



n n n p 



E EE En- 2 

5e0(fe,p) Vl=l 1,2=1 « P =iy=2 

n n n p— 1 n 

E E E ■" E Il^ticvjos E c7 »mp) u p 



n n n p— 1 

T 



— ^ E EE-- E II- 2 



w£G(k,p) v i = 1 "2 = 1 i> p -i = ly=2 
< . . . 

n 

<A^ £ E 1 - 

= nA p - 1 |a(fc,p)|. 



Combining it with inequality (jH]), we get 

|E (Traced)) | < £ J] a 2 

u>S0(ri,fc) eeE(tu) 
fc/2+1 

-EE n *: 

p=2 weS(n,k) e£E(w) 
fc/2+1 

p=2 
fc/2+1 



' / I, \ 

Af-M 2 ^_ 2 j2 2fe - 2 f+V" 2p+2 (fc-2p + 4) fe - 2 f+ 2 



In the last step, we applied Vu's bound (HI]). Let S(n, k,p) := nA?" 1 ( 2p ^J 2 2fc - 2 *>+ V _2p+2 
2p + 4) fe - 2 P+ 2 . One can show 

16fc 4 

S{n,k,p- 1) < ——S{n,k,p). 



G 



When k 4 < A ? we have S(n,k,p - 1) < \S{n,k,p). Thus, 

fe/2+1 

|E (Trace(B fe )) | < ^ S(n,k,p) 

p=2 

fc/2+l ^ fc/2+l-p 

<S(n,fc,fc/2 + l) J] - 

p=2 ^ 

< 2S(n, k, k/2 + 1) 
= n2 fc + 2 A fc / 2 . 

The proof of this Lemma is finished. □ 

Now we are ready to prove Theorem [6] 
Proof of Theorem [6J We have 

Pr(||B|| > 2VA + CA 1 / 4 lnn) =Pr(||B|| fc > (2^A + CA 1 / 4 In n) k ) 

< Pr(Trace(||B|| fe ) > (2\/A + CA 1 / 4 lnn) fe ) 

E(Tracc(||B|| fe )) 
" (2VA + CA 1 /4 i nn ))fc 

n2 fc+2 A fe/2 

(2-\/A + CA 1 / 4 lnn)) fe 

= 4 ne -(l+o(l))¥ fcA_1/4l n«. 



< 



Setting fe = (j^) 1 ^ 4 , we get 

Pr(||B|| > 2v / A + CA 1/4 lnn) = o(l) 

for sufficiently large C. The proof of Theorem [5] is finished. □ 
Proof of Theorem [TJ Let B = A — A. Notice \bij \ < 1 and Var(6,j) = p^ (1 — pij) < p^. 
Apply Theorem |5] to B with K = 1, of. = py, and A = maxi<^<i 52? =1 f>ij- We get 



||S|| < 2VA + CA 1 / 4 lnn. 

When A ^> In 4 n, we have 

||B||<(2 + (1))VA. 

Applying Weyl's Theorem, we get 

\Xi(A) - Xi{A)\ <\\A-A\\<(2 + o(l))VA. 
The proof of Theorem [1] is completed. □ 



3 Lemmas for Laplacian eigenvalues 

In this section, we will present some necessary lemmas for proving Theorem [21 Recall G is an 
edge- independent random graph over [n] such that forms as an edge with probability 

Pij independently. For I < i < j < n, let be the random indicator variable for 
being an edge; we have Pr(Xy = 1) = p^ and Pr(A^ = 0) = 1 — pij- For each vertex i G [n], 



7 



we use di and U to denote the degree and the expected degree of vertex i in G respectively. 
We have 

n n 

di = } Xjj and U = J^Pij. 

i=i i=i 

Let -D (and T) be the diagonal matrix with Da — di (and Tn — U) respectively. The matrix 
T is the expectation of D. Note that we use A and L to denote the adjacency matrix and the 
Laplacian matrix of G. Here L = I - D~ 1/2 AD~ 1/2 . Moreover, we let A := E(A) = (py)™,- =1 
be the expectation of A. We also define L = I — T^ 1 / 2 AT" 1 ^ 2 . The matrix L can be viewed 
as the "expected Laplacian matrix" of G. 

For notational convenience, we write eigenvalues of the expected Laplacian matrix L as 
Hi, fj,2, ■ ■ ■ , Hn such that 

|1 — A*x| > |1-M2| > ••• > 

By the definition of k and A, we have A = {fit, . . . , Hk} and |1 — = o(l/ \/ln n) for all 
i > k + 1. 

For 1 < i < n, let </>W be the orthonormal eigenvector of Hi for Z. Observe that <p^ 
can also be viewed as the orthonormal eigenvector for T~ x / 2 AT' 1 / 2 corresponding to the 
eigenvalue 1 - Hi- Thus we can rewrite T~ 1 / 2 AT~ 1 / 2 = £™ =1 (1 ~ Hi)^ ^ '■ Let M = 

E?=i(l " and N = Er=fc+i( 1 - A*i)0 (i) (0 '- Observe a fact ||JV|| = o(l/VhT^) 

and this fact will be used later. For a square matrix B, we define 

f(B) = ^-l/2 T l/2 BT l/2^-l/2 _ ^ 

We shall rewrite L — L as a sum of four matrices. Notice L — L = D^ 1 / 2 AD~ X I 2 — 
T- 1 / 2 AT- 1 / 2 . It is easy to verify L — L = M± + M 2 + M 3 + M 4 , where M l are follow- 
ing. 

Mi = T~ X I 2 (A — A)T~ X I 2 , 
M 2 = /(Mi), 
M 3 = /(TV), 
M 4 = /(M). 

Here the matrices M and JV are defined above. We will bound ||Mi|| for 1 < i < 4 separately. 
Lemma 2 If 5 In 4 n, then 

HMrll <(2 + o(l))i=. 

Proof: We are going to apply Theorem [5] to B = M X = T~ l f 2 {A - J 4)T" 1 / 2 . Note 

\bij\ < (*i*i) -1/a < V*> 

and 



Var(6«) = Var^-r^K- -ft,)) = ^4t^ < 7T 
Let X = 1/5 and erf - = We have 



A(B) = max V^-< max V - 



1,1, 1 (5 (5 
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By Theorem [6j we get 

\\B\\ < ^= + CS- 3 / 4 lnn. 
V5 



When <5 > In 4 n, we have CS~ 3 / 4 \nn = o(^=). Thus, we get ||Mi|| < and the proof 

of the lemma is finished. □ 
We have the following lemma on the function /. 

Lemma 3 If \\B\\ = o(l/Vhin), then \\f(B)\\ = o(l/y/S). 

Before we prove Lemma [31 we have two corollaries. 

Corollary 2 If S In 4 n, then we have \\M2W = o(l/v~5). 

Proof: Recall M 2 = /(Mi). By Lemma El we have 

||M 1 ||<^±^= (1/Vh^). 

By Lemma [21 we have this Corollary. □ 
Corollary 3 If 5 > In 4 n, then we have \\M 3 \\ = o(l/y/5). 

Proof: Recall M 3 = f(N). By the definition of N, we have ||iV|| = o(l/\Ann). Lemma| 
gives us the Corollary. □ 
To prove Lemma [3j we need the following Chernoff inequality. 

Theorem 7 J£jj Let X\ , . . . , X n be independent random variables with 

Pr(X t = 1) =Pi , Pr(X, = 0) = 1 - Pi . 

We consider the sum X = Y)j—y Xi, with expectation E(X) = Yli=iPi- Then we have 

(Lower tail) Pr(AT < E(X) - A) < e - x2 / 2E ( x \ 

(Upper tail) Vr(X > E(X) + A) < e wxj+x/s) . 

We can use the lemma above to prove the degree of each vertex concentrates around its 
expectation. 

Lemma 4 Assume ti > Inn for 1 < % < n. Then with probability at least 1 \, for all 

1 < i < n we have 

\di -U\ < Zy/U Inn. 

Proof: Recall is the random indicator variable for {i,j} being an edge. Note di = 
27=1 ^ij and E(c?i) = ~Y^—\Pij = U- Applying the lower tail of Chernoff 's inequality with 
A = 3\/ti logn, we have 

Pr(d i -t i <-A)<e- A2 / 2ti = -^j. 

Applying the upper tail of Chernoff's inequality with A = log n, we have 

x 2 l 
Pr (di -U> A) < e m+W < 



27/8 ' 



The union bound gives the lemma. □ 
By LemmaHl we can write di = (1 + o(l))£,; for 1 < i < n. 
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Lemma 5 When S ^> Inn, we have 

||2J-1/2 T 1/2_J|| =0 



Inn 



and HT 1 / 2 !)- 1 / 2 !! =l + o(l). 



Proof: We note that D 1 / 2 T 1 / 2 — 7 is diagonal and the (i,i)-the entry is y/U/di — 1. We 
have 



V*7 



< 



o(l) 



In n , 



Inn 
17 



□ 



The first part of this lemma is proved while the second part follows from the triangle inequal- 
ity. The proof of the lemma is finished. 

We are ready to prove Lemma [3j 
Proof of Lemma M Recall that f(B) = £)-V 2 J' 1 / 2 BT :L / 2 D _1 / 2 - B. We have 

f{B) = j o-i/2 T i/2 BT i/2 i:) -i/2 _ B 

= D~ 1/2 T 1/2 BT 1/2 D~ 1/2 - BT 1/2 D~ 1/2 + BT 1/2 D~ 1/2 - B 
= (D-^T 1 / 2 - /)BTV 2 £>-V2 + B^D- 1 ' 2 - I). 

Recall Lemma [5j By the triangle inequality we have 

< \\D- 1/2 T 1/2 - 7||||B||||r 1/2 L>- 1/2 || + \\B\\\\{T 1/2 D- 1/2 - I)\\ 



< 



Inn 



||fl||(l + (l)) + ||B||0 



Inn 



1 

71 

We use the assumption ||S|| = o(l/Vhin) in the last step and we completed the proof of the 
lemma. □ 



4 Proof of Theorem [2] 

It remains to estimate ||M 4 ||. Recall M 4 = f(M) and M = EiUC 1 _ 4> {i) ' ■ 

For 1 < i < n, write as a vector (</>^ , 2 , • • • , Let ||0M ||oc be the maximum 

over {l^^l, |02 I' '* ' i \4>n |}- We have the following lemma. 

Lemma 6 For each 1 < i < n, we have 

|1 Halloo < 4- 
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Proof: Assume H^'Hoc = \4^\ f° r some index j. Since is the orthonormal eigenvec- 
tor associated with 1 - m for T^ 1 / 2 AT^ 1 / 2 , we have T~ X I 2 AT~ X I 2 <^ = (1 - ^)</> W . In 
particular, (T _1 / 2 AT _1 / 2 (/>W)j = (1 - m)4>f holds. We have 

Halloo = |1-M,|l4 l) l 

= kt- 1 / 2 ^- 1 / 2 ^))^ 

s fe> ! i tea) 

1 / n \ 1/2 

1 

The lemma is proved. □ 

Lemma 7 Assume 5 3> Inn. For 1 < i < n, consider a random variable Xi := . jy e 

/iaue E(Xi) < 1 and VarpQ) < 2 + o(l) /or 1 < i < n, and CovpQ,Xj) = p ' j(1 ~ p ^ )(1 ~ 2p,j) 
/or 1 < i 7^ j < n. 

Proof: For 1 < i < j < n, recall that Xij is the random indicator variable for {i,j} being 
an edge. We define Yij = — pij. Thus we have di — ti = ^™ =1 i/j- Note that E(Yy) = 
and Var(Yy ■) = ^(1 - p lj ). We get E(JQ) = j- YTj=i Piji 1 ~ < We nave 



* y'l J2 J3 J4 / 



Since we have E(Yy) = 0, the non-zero term occurs either j\ = j 2 = jz = ji, or j\ = j 2 ^ 
js = ji , or ji = js 7^ j 2 = ji , or j\ = j 4 ^ j 2 = js . The contribution from the first case is 

n 1 n 1 71 1 

^^E(^) = _£(i - Pij f Pij +pf j (l-p ij ) < ^£>y = - = o(l) 
» j=i 1 j=i 1 j=i 

as we assume S 3> Inn. The contribution from the second case is 

The contribution from the third case and the forth case equal the contribution from the 
second case. Thus 

E(A 2 ) = o(l) 1^ p ih pi h {l-pi h ){l-p ij2 ). 

1 ]l¥=]2 
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We have 



1 ™ 1 

= + ^ Y Pi3lP*32 (1 ~ Pih)( l ~ Pih 

Therefore we get 



31=^32 



VarpQ) = E(Xf) - E(X t ) 2 
2 

= 72 Y (PihPihi 1 ~ PihK 1 ~ Pij 2 )) + O(l) 



< 



< 2 + 0(1). 

The covariance Cov(Xi, Xj) can be computed similarly. Here we omit the details. 



Lemma 8 For any non-negative numbers a±, 02, . . . a n , let X — X)"=i 
maxKKtiltti}- Then we have 

Pr [ X > V) eii + ry 

N * 

Proof: We have X = V'' ! «,.V,. where A — 



(rf,-t») 2 



□ 



Set a — 



1 * 2 + °W 



We shall use the second moment 
method to show that X concentrates around its expectation. By Lemma [71 we have E(JQ) < 
1. Thus E(X) < Y^i=i ai - Eor * ne variance, by Lemma [Jj we obtain 

n 

Var(AT) = afVar(Xi) + ^ a^Cov^X,) 

i=l i+j 



<£a?(2 + o(l))+££. 

2 — 1 I— 1 J — 1 



tjtj 



n n 



<(2 + o(l))aJ2a> + - s Y a >Yf 

i—1 z—1 i=i 



= (2 + o(l))a^a, 

i=l 

Applying Chebychev's inequality, we have 

(n n 
i=l \ i=l 



< Pr I X-E(X) > //, 
Var(AT) 



< 



< 



»? a Ei=l a * 
2 + 0(1) 
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□ 



We are ready to prove an upper bound on ||M4||. 
Lemma 9 If S 3> {k, ln 4 n} ; then we have 



||M 4 ||< (1 + (1))) 



V6 



Proof: Let $ := {(j)^, ■ ■ ■ , 4>^) be an n x k matrix such that its columns are mutually 
orthogonal and Q be a diagonal k x k matrix such that Qu = 1 — /Uj. We have M = 



Ei=i(! ~ ^)0 (J ¥ J) ' = W- Thus, 

M 4 = D- 1/2 T 1/2 MT 1/2 D- 1/2 - M 

= £>-l/2 T l/2 MT l/2 £)-l/2 _ MT l/2 £,-1/2 + MT V2 £)-l/2 _ M 

= (£)-V2 T i/2 _ i)MT x l 2 D- x l 2 + M(T X I 2 D- X I 2 - I) 

= (£-l/2 T l/2 _ ^^Q^'T 1 ^^-!^ + $ Q $ / (T l/2^-l/2 _ 7) 

LetZ7= (D-^ 2 T^ 2 -I)^Q. By the definition of $, we have ||$|| = 1. Since WT^D' 1 ^ = 
1 + o(l), by the triangle inequality, we get 



I|m 4 || = wu&tWd- 1 ' 2 + ®u'\\ 

^IIC/IIII^IIIItV^-i^ii + i^ihi^ii 
= (2 + o(l))||[/||. 



By the definition of the norm of a non-square matrix, we have 



\\U\\ = y/WU F \ 



< v /Trace([/[/') 



= ^Trace ((L»^ 1 / 2 T 1 /2 _ /^QQi^TV^D 1 ^ - /)) 




Leta,:=E-=i(l-w) 2 (#) 



We have the following estimate on the norm of U, 




f^ 3 dj(^t] + V^) 2 



(i+ (i))5>j 



< 
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Note that 



n n k 



E°i = EE( 1 -«) a W 

t=l 3=1 

E(l-Mi) 2 - 



3=1 3=1 »=1 

fc 



By Lemma [HI we have 
Hence, for 1 < j < n, we get 



|i-i*HI# ( "IU<^- 



If we let a = maxi<j<„{aj}, then we have a < K. 

Choose ?7 := v^/s/ifc; we have i) -) oo as n approaches the infinity. Applying Lemma 
with probability 1 — o(l), we have 



3=1 



3=1 



a E a J 



3=1 



*Eo -*>' + != 

£= 1 



lEd-^) 2 



^(l- Mi )2 + (l) 



Therefore, we get the following upper bounds on \\U\\ and \\Ad4 



i=l 

2 



\\U\\< (l + o(l)) 



Ef=i(i-w) 



and 



||M 4 || < (l + o(l)) 



Eti(l-M,) 2 V^a 6 a(1-A^ 



(l + o(l)))- 



We proved the lemma. 

Proof of Theorem [2} Recall L — L = Mi + M2 + M3 + M4,. By the triangle inequality, we 
have \\L - L\\ < \\Mi\\ + \\M 2 \\ + \\M 3 \\ + ||M 4 ||. Combining LemmaEl CorollaryEJ Corollary 



□ 
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El and Lemma 13 we get 

\\L-L\\ <||M 1 || + ||M 2 || + ||M 3 || + ||M 4 | 



< (2 + o(l))-= + +0 + (l + (1)) 



Y2 



Vs \VsJ \VsJ Vs 



N Ed -<*)•+«(»)) ^ 

Finally we apply Weyl's Theorem. The proof of Theorem [2] is finished. □ 
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